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' Abstract 

In financial markets, liquidity is not constant over time but exhibits strong seasonal patterns. In 
' this article we consider a limit order book model that allows for time-dependent, deterministic depth 

and resilience of the book and determine optimal portfolio liquidation strategies. In a first model 
variant, we propose a trading dependent spread that increases when market orders are matched 
Ch ' against the order book. In this model no price manipulation occurs and the optimal strategy is of 

C^_^ , the wait region - buy region type often encountered in singular control problems. In a second model, 

we assume that there is no spread in the order book. Under this assumption we find that price 
manipulation can occur, depending on the model parameters. Even in the absence of classical price 
manipulation there may be transaction triggered price manipulation. In specific cases, we can state 
the optimal strategy in closed form. 
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5 ■ 1 Introduction 

Empirical investigations have demonstrated that liquidity varies over time. In particular deterministic 
\ time-of-day and day-of-week liquidity patterns have been found in most markets, see, e.g., Chordia, Roll, 

. and Subrahmanyam (2001), Kempf and Mayston (2008) and Lorenz and Osterrieder (2009). In spite 

' of these findings the academic literature on optimal trade execution usually assumes constant liquidity 

during the trading time horizon. In this paper we relax this assumption and analyze the effects of 
deterministicalljf^ varying liquidity on optimal trade execution for a risk-neutral investor. We characterize 
optimal strategies in terms of a trade region and a wait region and find that optimal trading strategies 
depend on the expected pattern of time-dependent liquidity. In tire case of extreme changes in liquidity. 
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e.g., Esser and Monch (2003) and Steinmann (2005). See, e.g., Fruth (2011) for an analysis of the implications of such 
stochastic liquidity on optimal trade execution. 
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it can even be optimal to entirely refrain from trading in periods of low liquidity. Incorporating such 
patterns in trade execution models can hence lower transaction costs. 

Time-dependent liquidity can potentially lead to price manipulation. In periods of low liquidity, a trader 
could buy the asset and push market prices up significantly; in a subsequent period of higher liquidity, 
he might be able to unwind this long position without depressing market prices to their original level, 
leaving the trader with a profit after such a round trip trade. In reality such round trip trades are often not 
profitable due to the bid-ask spread: once the trader starts buying the asset in large quantities, the spread 
widens, resulting in a large cost for the trader when unwinding the position. We propose a model with 
trading-dependent spread and demonstrate that price manipulation does not exist in this model in spite 
of time-dependent liquidity. In a similar model with fixed zero spread we find that price manipulation or 
transaction-triggered price manipulation (a term recently coined by Alfonsi, Schied, and Slynko (2011) 
and Gatheral, Schied, and Slynko (2011b)) can be a consequence of time-dependent liquidity. Phenomena 
of such type, i.e. existence of "illusory arbitrages", which disappear when bid-ask spread is taken into 
account, are also observed in different modelling approaches (see e.g. Section 5.1 in Madan and Schoutens 
(2011)). 

Our liquidity model is based on the limit order book market model of Obizhaeva and Wang (2006), which 
models both depth and resilience of the order book explicitly. The instantaneously available liquidity in 
the order book is described by the depth. Market orders issued by the large investor are matched with 
this liquidity, which increases the spread. Over time, incoming limit orders replenish the order book and 
reduce the spread; the speed of this process is determined by the resilience. In our model both depth and 
resilience can be independently time dependent. We show that there is a time dependent optimal ratio of 
remaining order size to bid-ask spread: If the actual ratio is larger than the optimal ratio, then the trader 
is in the "trade region" and it is optimal to reduce the ratio by executing a part of the total order. If the 
actual ratio is smaller than the optimal ratio, then the trader is in the "wait region" and it is optimal to 
wait for the spread to be reduced by future incoming limit orders before continuing to trade. 

Building on empirical investigations of the market impact of large transactions, a number of theoretical 
models of illiquid markets have emerged. One part of these market microstructure models focuses on the 
underlying mechanisms for illiquidity effects, e.g., Kyle (1985) and Easley and O'Hara (1987). We follow 
a second line that takes the liquidity effects as given and derives optimal trading strategies within such 
a stylized model market. Two broad types of market models have been proposed for this purpose. First, 
several models assume an instantaneous price impact, e.g., Bertsimas and Lo (1998), Almgren and Chriss 
(2001) and Almgren (2003). The instantaneous price impact typically combines depth and resilience of 
the market into one stylized quantity. Time-dependent liquidity in this setting then leads to executing 
the constant liquidity strategy in volume time or liquidity time, and no qualitatively new features occur. 
In a second group of models resilience is finite and depth and resilience are separately modelled, e.g., 
Bouchaud, Gefen, Potters, and Wyart (2004), Obizhaeva and Wang (2006), Alfonsi, Fruth. and Schied 
(2010) and Predoiu, Shaikhet, and Shreve (2011). Our model falls into this last group. Allowing for 
independently time-dependent depth and resilience leads to higher technical complexity, but allows us to 
capture a wider range of real world phenomena. 

The remainder of this paper is structured as follows. In the next section, we introduce the market model 
and formulate an optimization problem. In Section[3l we show that this model is free of price manipulation, 
which allows us to simplify the model setup and the optimization problem in Section|4l Before we state our 
main results on existence, uniqueness and characterization of the optimal trading strategy in Sections |6] 
to [71 we first provide some elementary properties, like the dimension reduction of our control problem, in 
Section [S] Section [HI discusses the case where trading is constrained to discrete time and Section [7] contains 
the continuous time case. In Section [S] we investigate under which conditions price manipulation occurs 
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in a zero spread model. In some special cases, we can calculate optimal strategies in closed form for our 
main model as well as for the zero spread model of Section [SJ we provide some examples in Section [51 
Section [TU] concludes. 



2 Model description 

In order to attack the problem of optimal trade execution under time-varying liquidity, we first need to 
specify a price impact model in Section 12.11 Our model is based on the work of Obizhaeva and Wang 
(2006), but allows for time- varying order book depth and resilience. Furthermore we explicitly model 
both sides of the limit order book and thus can allow for strategies that buy and sell at different points 
in time. After having introduced the limit order book model, we specify the trader's objectives in Section 
[2:21 

2.1 Limit order book and price impact 

Trading at most public exchanges is executed through a limit order book, which is a collection of the 
limit orders of all market participants in an electronic market. Each limit order has the number of shares, 
that the market participant wants to trade, and a price per share attached to it. The price represents a 
minimal price in case of a sell and a maximal price in case of a buy order. Compared to a limit order, 
a market order does not have an attached price per share, but instead is executed immediately against 
the best limit orders waiting in the book. Thus, there is a tradeoff between price saving and immediacy 
when using limit and market orders. We refer the reader to Cont, Stoikov, and Talreja (2010) for a more 
comprehensive introduction to limit order books. 

In this paper we consider a one-asset model that derives its price dynamics from a limit order book that 
is exposed to repeated market orders of a large investor (sometimes referred to as the trader). The goal 
of the investor is to use market orderij^ in order to purchase a large amount x of shares within a certain 
time period [0,r], where T typically ranges from a few hours up to a few trading days. Without loss 
of generality we assume that the investor needs to purchase the asset (the sell case is symmetrical) and 
hence first describe how buy market orders interact with the ask side of the order book (i.e., with the sell 
limit orders contained in the limit order book) . Subsequently we turn to the impact of buy market orders 
on the bid side and of sell market orders on both sides of the limit order book. 

Suppose first that the trader is not active. We assume that the corresponding unaffected best ask price 
(i.e. the lowest ask price in the limit order book) is a cadlag martingale on a given filtered probability 
space (r2, J^, (J-'()jg[Q 7^], P) satisfying the usual conditions. This unaffected price process is capturing 
all external price changes including those due to news as well as due to trading of noise traders and 
informed traders. Our model includes in particular the case of the Bachelier model ^ Aq+ (tW/^ with 
a (J"t)-Browman motion W^, as considered in Obizhaeva and Wang (2006). It also includes the driftless 
geometric Brownian motion A" = exp{aW^ — ■^cr'^t), which avoids the counterintuitive negative prices 
of the Bachelier model. Moreover, we can allow for jumps in the dynamics of A". 

We now describe the shape of the limit order book, i.e. the pattern of ask prices in the order book. We 
follow Obizhaeva and Wang (2006) and assume a block-shaped order book: The number of shares offered 

■^On this macroscopic time scale, the restriction to market orders is not severe. A subsequent consideration of small time 
windows including limit order trading is common practice in banks. See Naujokat and Westray (2011) for a discussion of a 
large investor execution problem where both market and limit orders are allowed. 



3 



Number of shares 



LOB 
height q, 




^ Resilience 



marl<et buy 

order: 
^, shares 



a: 



A,=A>D, A,.=A>D,, 



. Price per share 



extra 

limit buy orders spread spread limit sell orders 

Figure 1: Snapshot of the block-shaped order book model at time t. 



at prices in the interval [A" , A" + A A] is given by qt ■ A A with > being the order book height (see 
Figure[T]for a graphical illustration). Alfonsi, Fruth, and Schied (2010) and Predoiu, Shaikhet, and Shreve 
(2011) consider order books which are not block shaped and conclude that the optimal execution strategy 
of the investor is robust with respect to the order book shape. In our model, we allow the order book 
depth qt to be time dependent. As mentioned above, various empirical studies have demonstrated the 
time-varying features of liquidity, including order book depth. In theoretical models however, liquidity is 
still usually assumed to be constant in time. To our knowledge first attempts to non-constant liquidity 
in portfolio liquidation problems has only been considered so far in extensions of the Almgren and Chriss 
(2001) model such as Kim and Boyd (2008) and Almgren (2009). In this modelling framework, price 
impact is purely temporary and several of the aspects of this paper do not surface. 



Let us now turn to the interaction of the investor's trading with the order book. At time t. the best ask At 
might differ from the unaffected best ask due to previous trades of the investor. Define Dt := At — A" 
as the price impact or extra spread caused by the past actions of the trader. Suppose that the trader 
places a buy market order of > shares. This market order consumes all the shares offered at prices 
between the ask price At just prior to order execution and At+ immediately after order execution. At+ is 
given by {At+ — At) ■ qt — S.t and we obtain 



Dt+ = Dt+ ^t/qt 



See Figure [T] for a graphical illustration. 



It is a well established empirical fact that the price impact D exhibits resilience over time. We assume 
that the immediate impact S,t/qt can be split into a temporary impact component KtS,t which decays to 
zero and a permanent impact component 7^4 with 

7 + A't = qt\ 

We assume that the temporary impact decays exponentially with a fixed time-dependent, deterministic 
recovery rate pt > 0. The price impact at time s > i of a buy market order > placed at time t is 
assumed to be 



Kte^ 



Notice that this temporary impact model is different to the one which is used, e.g., in Almgren and Chriss 
(2001) and Almgren (2003). It slowly decays to zero instead of vanishing immediately and thus prices 
depend on previous trades. Obizhaeva and Wang (2006) limit their analysis to a constant decay rate 
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pt = p, but suggest the extension to time dependent pt. Weiss (2010) considers exponential resilience 
and shows that the results of Alfonsi, Fruth, and Schied (2010) and in particular Obizhaeva and Wang 

(2006) can be adapted when the recovery rate depends on the extra spread D caused by the large investor. 
Gatheral (2010) considers more general deterministic decay functions than the exponential one in a model 
with a potentially non-linear price impact and discusses which combinations of decay function and price 
impact yield 'no arbitrage', i.e. non-negative expected costs of a round trip. Alfonsi, Schied, and Slynko 
(2011) study the optimal execution problem for more general deterministic decay functions than the 
exponential one in a model with constant order book height. For the calibration of resilience see Large 

(2007) and for a discussion of a stochastic recovery rate p we refer to Fruth (2011). 

Let us now discuss the impact of market buy orders on the bid side of the limit order book. According to 
the mechanics of the limit order book, a single market buy order directly influences the best ask At+, 
but does not influence the best bid price Bt+ — Bt immediately. The best ask At+ recovers over time (in 
the absence of any other trading from the investor) on average to At + 7^4. In reality market orders only 
lead to a temporary widening of the spread. In order to close the spread, Bt needs to move up by 7^4 
over time and converge to Bt -\- 7^4, i.e. the buy market order influences the future evolution of B. We 
assume that B converges to this new level exponentially with the same rate pt. The price impact on the 
best bid B^ at time s > t of a buy market order > placed at time t is hence 



We assume that the impact of sell market orders is symmetrical to that of buy market orders. It should 
be noted that our model deviates from the existing literature by explicitly modelling both sides of the 
order book with a trading dependent spread. For example Obizhaeva and Wang (2006) only model one 
side of the order book and restrict trading to this side of the book. Alfonsi, Schied, and Slynko (2011), 
Gatheral, Schied, and Slynko (2011b) and Gatheral, Schied, and Slynko (2011a) on the other hand allow 
for trading on both sides of the order book, but assume that there is no spread, i.e. they assume A" = i?" 
for unaffected best ask and best bid prices, and that the best bid moves up instantaneously when a market 
buy order is matched with the ask side of the book. They find that under this assumption the model 
parameters (for example the decay kernel) need to fulfill certain conditions, otherwise price manipulation 
arises. We will revisit this topic in Sections [3] and [S] 

We can now summarize the dynamics of the best ask At and best bid Bt for general trading strategies 
in continuous time. Let and O be increasing processes that describe the number of shares which the 
investor bought respectively sold from time until time t. We then have 

At = A^ + Dt, 
Bt = Bt — Et , 



where 



Dt ^ Doe- ^0 P^''' + [ (j + K,e-^>-''")des - [ (l - dS^, te[0,T+], (1) 

J[o,t) ^ ' J[o,t) ^ ' 

Et^Eoe-I>^'''+ f (j + Kse-I>-''Ades- f j (l - fsP-''A dQ,, t e [0,T+], (2) 

J[o,t) ^ ' J[o,t) ^ ^ 



with some given nonnegative initial price impacts Dq > and i?o > 0. 

Assumption 2.1 (Basic assumptions on 0, 8, A", i?", and p). 
Throughout this paper, we assume the following. 
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• The set of admissible strategies is given as 

^0 := {(©, 0): fl X [0, T+] — s> [0, oo)^ | 9 and 9 are (J^t)-adapted nondecreasing 
bounded caglad processes with (9o, 9o) = (0, 0)}. 

Note that (9, 9) may have jumps. In particular, trading in rates and impulse trades are allowed. 

• The unaffected best ask price process A" is a cadlag "H^-martingale with a deterministic starting 
point Aq, i.e. 

Ev/[A", A"]t < 00, or, equivalently, E sup < oo. 

te[o,T] 

The same condition holds for the unaffected best bid price S". Furthermore, i?" < A" for all t E 

[o,r]. 

• The price impact coefficient K : [0,T] — )■ (0, cxo) is a deterministic strictly positive bounded Borel 
function. 

• The resilience speed p: [0,T] — > (0, oo) is a deterministic strictly positive Lebesgue integrable func- 
tion. 

Remark 2.2. 

i) The purchasing component 9 of a strategy from consists of a left-continuous nondecreasing process 
{Qt)te[o,T] and an additional random variable 9t+ with A9t := 9t+ — 9t > being the last 
purchase of the strategy. Similarly, for t S [0,T], we use the notation A9t := Qt+ — 9t. The same 
conventions apply for the selling component 9. 

ii) The processes D and E depend on (9, 9), although this is not explicitly marked in their notation. 

iii) As it is often done in the literature on optimal portfolio execution, 9, 9, D and E are assumed to 
be caglad processes. In ((T]), the possibility t = T+ is by convention understood as 

Dt+ = Doe- ^0 P^ds _^ f / ^ ^^g- p„d«\ „ f P.du^Q^ 

J[0,T] ^ ' J[0,T] 

A similar convention applies to all other formulas of such type. Furthermore, the integrals of the 
form 

/ KsdSs or / KsdQs, 

J[0,t) J[Q,t] 

are understood as pathwise Lebesgue-Stieltjes integrals, i.e. Lebesgue integrals with respect to the 
measure with the distribution function s 9^+. 

iv) In the sequel, we need to apply stochastic analysis (e.g. integration by parts or Ito's formula) to caglad 
processes of finite variation and/or standard semimartingales. This will always be done as follows: 
if (7 is a caglad process of finite variation, we first consider the process defined by :— Ut+ and 
then apply standard formulas from stochastic analysis to it. An example (which will be often used 
in proofs) is provided in Appendix El 
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2.2 Optimization problem 



Let us go ahead by describing the cost minimization problem of the trader. When placing a single buy 
market order of size > at time t, he purchases at prices A" + d, with d ranging from Dt to Dt+, see 
Figure [TJ Due to the block-shaped limit order book, the total costs of the buy market order amount to 

(^r + Dt) 6 + ^^^-Y^^t = {A- + D,) 6 + ^ = 6 (a^ + |-) . 

Thus, the total costs of the buy market order are the number of shares times the average price per 
share (At + ^). More generally, the total costs of a strategy {Q, Q) e are given by the formula 

J[0,T] \ J J[o,T] \ j 

We now collect all admissible strategies that build up a position of a; e [0, oo) shares until time T in the 
set 

Aq(x) := |(e, Q) eAo\ Ot+ - 6t+ = x a.s.j . 
Our aim is to minimize the expected execution costs 

inf EC(e,e). (3) 

We hence consider the large investor to be risk-neutral and explicitly allow for his optimal strategy to 
consist of both buy and sell orders. In the next section, we will see that in our model it is never optimal 
to submit sell orders when the overall goal is the purchase of x > shares. 

Let us finally note that problem ([3]) with x G (— oo, 0] is the problem of maximizing the expected proceeds 
from liquidation of shares and, due to symmetry in modelling ask and bid sides, can be considered 
similarly to problem ^ with x G [0, cxd). 



3 Market manipulation 

Market manipulation has been a concern for price impact models for some time. We now define the 
counterparts in our model of the notions of price manipulation in the sense of Huberman and Stanzl 
(2004) and of transaction-triggered price manipulation in the sense of Alfonsi, Schied, and Slynko (2011) 
and Gatheral, Schied, and Slynko (2011b). Note that in defining these notions in our model we explicitly 
account for the possibility of Dq and Eq being nonzero. 

Definition 3.1. A round trip is a strategy from ^o(O). A price manipulation strategy is a round trip 
(9,6) G .4o(0) with strictly negative expected execution costs EC(9,6) < 0. A market impact model 
(represented by A", i?", K, and p) admits price manipulation if there exist Dq > 0, i?o > and 
(6, 6) G AoiO) with EC(e, 6) < 0. 

Definition 3.2. A market impact model (represented by A", _B", K, and p) admits transaction-triggered 
price manipulation if the expected execution costs of a buy (or sell) program can be decreased by inter- 
mediate sell (resp. buy) trades. More precisely, this means that there exist x G [0,oo), Dq > 0, Eq > 
and (6", 6°) G Aoix) with 

EC(e*',e°) < inf{EC(e,o) | (e,o) g ^0(2;)} (4) 
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or there exist x G (-00, 0], Do > 0, £^0 > and (6°, 6") £ ^0(2^) with 

EC(e", e°) < inf{EC(o, e) | (o, e) e A^ix)]. 



(5) 



Clearly, if a model admits price manipulation, then it admits transaction-triggered price manipulation. 
But transaction-triggered price manipulation can be present even if price manipulation does not exist in 
a model. This situation has been demonstrated in limit order book models with zero bid-ask spread by 
Schoneborn (2008) (Chapter 9) in a multi-agent setting and by Alfonsi, Schied, and Slynko (2011) in a 
setting with non-exponential decay of price impact. In this section, we will show that the limit order book 
model introduced in Section [2] is free from both classical and transaction-triggered price manipulation. In 
Section [8] we will revisit this topic for a different (but related) limit order book model. 



Before attacking the main question of price manipulation in Proposition 13. 4[ we consider the expected 
execution costs of a pure purchasing strategy and verify in Proposition 13.31 that the costs resulting from 
changes in the unaffected best ask price are zero and that the costs due to permanent impact are the same 
for all strategies. 

Proposition 3.3 (Only temporary impact has to be considered). 
Let {Q, Q) G Ao{x) with x G [0, ex:) and = 0. Then 



E 



A, + ^Mo. 

[0,T] \ ^It 



= A^x -f + E 



[0,T] 



D 



7=0 



AOf dO 



with 



D]-° -.^ Doe- -fo P-'i'^ + [ i^,e- dO,, te[0,T+]. 
J[o,t) 



(6) 
(7) 



Proof. We start by looking at the expected costs caused by the unaffected best ask price martingale. 
Using (j48| with U := Q, Z := A", the facts that O is bounded and that is an 7^^-martingale yield 



E 



AfdOt 



[O.T] 



:[A;^eT+-A^Qo]^A^x. 



(8) 



Let us now turn to the simplification of our optimization problem due to permanent impact. To this end, 

■70* 



we differentiate between the temporary price impact D] and the total price impact Dt — D 
that we get by adding the permanent impact. Notice that = 0. We can then write 

E 



.7=0 



[o,T] V '^Qt 



= A^x + E 
= A^x + E 



[0,T] 



[O.T] 



Dr" + iOt + ^^Aet]det 



or' 



Kt 



AO* dO 



-7E 



[a.T] 



o* + ^Mo* 



The assertion follows, since integration by parts for caglad processes (see (l49l) with U ^ V :~ 0) and Oo 
0, Ot+ = X yield 



[0,T] 



* 2 / 2 2 



(9) 
□ 
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We can now proceed to prove that our model is free of price manipulation and transaction-triggered price 
manipulation. 

Proposition 3.4 (Absence of transaction-triggered price manipulation). 

In the model of Section\^ there is no transaction-triggered price manipulation. In particular, there is no 
price manipulation. 

Proof. Consider x G [0,00) and (6,6) G Aq{x). Making use of 

Bt =B]^-Et<A^-Et<A^+j (et - 6*) 

yields 



E 



> E 



[Q,T] \ ^Qt 



[0,T] 



[0,T] 



A," + 76* + D 



7=0 
t 



76* + ^A6t + ^Ae* ) d&t 



-E 



A^ + jQt ~ 70t - ^Ae* - ^Ae* ) dOt 



> E 



A'^diOt - Qt) 



[0,T] 



-E 



[0,T] 



et-6t-f ^ 1 dQt 



[0,T] 



Ae, dQ 



Analogously to ([5]), the first of these terms equals A^x since 6, 6 are bounded and A^ is an "H^-martingale. 
For the second one, we do integration by parts (use three times) to deduce 

{2Qt + ^Qt)dQt+ ( (26* + Aet) - 2 /" etdQt-^f QtdQt 

[0,T] ■J[0,T] ^ ' J[n,T] J[n,T] 

6|+ + - 2eT+eT+ - 2 / QtdQt +2 [ Qt+dQt > (Qt+ ~ Qt+Y = x\ 



[Q,T] 



That is we have shown 



E 



[O.T] \ ^Qt / J[o,T] V ^Qt I 



> A^x + ^x^+E 



[O.T] 



A6t dQt 



and thanks to Proposition 13.31 the right-hand side is larger or equal to the expected execution costs of the 
strategy (6,0) G Aq{x) with 

6f if 6t < X 
X otherwise 



6, 



9 



Hence, the expected execution costs of a buy program (8, 9) £ Aq{x) containing a selling component is 
always greater or equal to the costs of the modified strategy (6,0) G A(){x) without a selling component. 
Thus, (HI does not occur. By a similar reasoning, ([5]) does not occur as well. □ 

The central economic insight captured in the previous proposition is that price manipulation strategies 
can be severely penalized by a widening spread. This idea can easily be applied to different variations of 
our model, for example to non-exponential decay kernels as in Gatheral, Schied, and Slynko (2011b). 



4 Reduction of the optimization problem 

Due to Propositions 13.31 and 13.41 we can significantly simplify the optimization problem Q . Let us fix 
X G [0, cx)). Then it is enough to minimize the expectation in the right-hand side of (|6]) over the pure 
purchasing strategies that build up the position of x shares until time T. That is to say, the problem 
in general reduces to that with A" = 0, 7 = 0, 8 = 0. Moreover, due to (l6|), ([7]) and the fact that K 
and p are deterministic functions, it is enough to minimize over deterministic purchasing strategies. We 
are going to formulate the simplified optimization problem, where we now consider a general initial time 
t G [0,T] because we will use dynamic programming afterwards. 

Let us define the following simplified control sets only containing deterministic purchasing strategies: 

At := {8: [t,T-|-] [0, 00) | 8 is a deterministic 

nondecreasing caglad function with 8t = O}, 
At{x) := {8 G A I 8t+ = x}. 

As above, a strategy from At consists of a left-continuous nondecreasing function {Qs)selt.T] and an 
additional value Qt+ G [0, 00) with A8t := 8t+ — 8t > being the last purchase of the strategy. For 
any fixed t G [0, T] and S G [0, 00), we define the cost function J{t, S, •) : A — > [0, 00) as 

J(8) J{t, S, 8) (^D^ + ^A8,^ rf8„ (10) 

where 

:=5e- / Kuc-f dQu, s G [t,T+]. (11) 

The cost function J represents the total temporary impact costs of the strategy 8 on the time interval [t, T] 
when the initial price impact Dt ~ S. Gbserve that J is well-defined and finite due to Assumption 12.11 

Let us now define the value function for continuous trading time U : [0, T] x [0, 00)^ — > [0, 00) as 

U{t,6,x):^ inf J(t,S,e). (12) 

eeAtix) 

We also want to discuss discrete trading time, i.e. when trading is only allowed at given times 

O^to <ti < ... <tN = T. 
Define h{t) := inf{n = 0, ...,N\tn > t}. We then have to constrain our strategy sets to 

A^ := {8 G A |8, = on [t,t,^f,], 83 = 8t„+ on (i„,t„+i] for n = n(i), iV - 1} C At, 
A^{x) {8 G I 8t+ ^x}c At{x), 
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and the value function for discrete trading time becomes 



U^{t,6,x) ; 



inf J{t,5,Q)>U{t,5,x). 



(13) 



Note that the optimization problems in continuous time (|12p and in discrete time (|13p only refer to the 
ask side of the limit order book. The results for optimal trading strategies that we derive in the following 
sections are hence applicable not only to the specific limit order book model introduced in Section [21 
but also to any model which excludes transaction-triggered price manipulation and where the ask price 
evolution for pure buying strategies is identical to the ask price evolution in our model. This includes 
for example models with different depth of the bid and ask sides of the limit order book, or different 
resiliences of the two sides of the book. 

We close this section with the following simple result, which shows that our problem is economically 
sensible. 

Lemma 4.1 (Splitting argument). 

Doing two separate trades S,a,^p > at the same time s has the same effect as trading at once ^ :— Ca+?/3) 
i.e., both alternatives incur the same impact costs and the same impact Ds+. 

Proof. The impact costs are in both cases 



5 Preparations 

In this section, we first show that in our model optimal strategies are linear in ((5, x), which allows us 
to reduce the dimensionality of our problem from three dimensions to two dimensions. Thereafter, we 
introduce the concept of WR-BR structure in Section !??^ which appropriately describes the value function 
and optimal execution strategies in our model as we will see in Sections [5] and [71 Finally, we establish 
some elementary properties of the value function and optimal strategies in Section 15.31 

In this entire section, we usually refer only to the continuous time setting, for example, to the value 
function U . We refer to the discrete time setting only when there is something there to be added explicitly. 
But all of the statements in this section hold both in continuous time (i.e. for U) and in discrete time 
(i.e. for U^), and we will later use them in both situations. 

5.1 Dimension reduction of the value function 

In this section, we prove a scaling property of the value function which helps us to reduce the dimension 
of our optimization problem. Our approach exploits both the block shape of the limit order book and the 
exponential decay of price impact and hence does not generalize easily to more general dynamics of D as. 




and the impact Dgj^ — Dg + Kg (C 



.a 



+ ^fs) after the trade is the same in both cases as well. 



□ 
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e.g., in Predoiu, Shaikhet, and Shreve (2011). We formulate the result for continuous time, although it 
also holds for discrete time. 

Lemma 5.1 (Optimal strategies scale linearly). 
For all a G [0, oo) we have 

U{t,aS,ax) =a'^U{t,S,x). (14) 
Furthermore, if Q* G At{x) is optimal for U{t,6,x), then aO* G At{ax) is optimal for U(t,aS,ax). 



Proof. The assertion is clear for a = 0. For any a G (0, oo) and G ^t, we get from (fTO|) and (fTT|) that 

J(t,ad,ae) ^ a^J{t,d,e). (15) 

Let 8* G At{x) be optimal for U{t,6,x) and 8 G At{ax) be optimal for U{t,a5,ax). If no such optimal 
strategies exist, the same arguments can be performed with minimizing sequences of strategies. Using ()15|) 
two times and the optimality of 8*, 8, we get 

J{t, a6, 8) < J(t, aS, a8*) = aV(i, S, 8*) < aV ^t, S, ^8^ = J{t, aS, 8). 

Hence, all inequalities are equalities. Therefore, a8* is optimal for U{t,aS,ax) and ([T^ holds. □ 



For (5 > 0, we can take a ~ ^ and apply Lemma to get 

U(t,S,x) = S^U (t,l,^'j ^ S^V{t,y) with (16) 

X 

V{t,y) U{t,l,v), V{T,y)=y + ^y\ V[t,Q)=Q. 

In this way we are able to reduce our three-dimensional value function U defined in p2p to a two- 
dimensional function V. That is U(LSfix,x) for some Sfix > or U{t,d,Xfix) for some Xfix > already 
determines the entire value functior|f|. Instead of keeping track of the values x and i5 separately, only the 
ratio of them is important. It should be noted however that the function V itself is not necessarily the 
value function of a modified optimization problem. In a similar way we define the function through 
the function . 



5.2 Introduction to buy and wait regions 

Let us consider an investor who at time t needs to purchase a position of a; > in the remaining time 
until T and is facing a limit order book dislocated hy Dt — S > 0. Any trade at time t is decreasing 
the number of shares that are still to be bought, but is increasing D at the same time (see Figure [5] for 
a graphical representation). In the (5-x-plane, the investor can hence move downwards and to the right. 
Note that due to the absence of transaction-triggered price manipulation (as shown in Proposition 13.41) 
any intermediate sell orders are suboptimal and hence will not be considered. 

^In the following, we will often analyze the function V in order to derive properties of U. Technically this does not 
directly allow us to draw conclusions for U{t,0,x), where (5 = 0, since in this case y = x/5 is not defined. The extension 
of our proofs to the possibility 5 = however is straightforward using continuity arguments (see Proposition 15.51 below) or 
alternatively by analyzing V{t,y) := U{t,y, 1). 
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Figure 2: The S-x-pl&ne for fixed time t. 



Intuitively one might expect the large investor to behave as follows: If there are many shares x left to be 
bought and the price deviation S is small, then the large investor would buy some shares immediately. In 
the opposite situation, i.e. small x and large 6, he would defer trading and wait for a decrease of the price 
deviation due to resilience. We might hence conjecture that the i5-a;-plane is divided by a time-dependent 
barrier into one buy region above and one wait region below the barrier. Based on the linear scaling 
of optimal strategies (Lemma 15. ip . we know that if {d,x) is in the buy region at time i, then, for any 
a > 0, {ad, ax) is also in the buy region. The barrier between the buy and wait regions therefore has 
to be a straight line through the origin and the buy and sell region can be characterized in terms of the 
ratio y = ^. In this section, we formally introduce the buy and wait regions and the barrier function. In 
Sections [5] and [71 we prove that such a barrier exists for discrete and continuous trading time respectively. 
In contrast to the case of a time-varying but deterministic illiquidity K considered in this paper, for 
stochastic K, this barrier conjecture holds true in many, but not all cases, see Fruth (2011). 

We first define the buy and wait regions and subsequently define the barrier function. Based on the above 
scaling argument, we can limit our attention to points (1, y) where ^ = 1, since for a point ((5, x) with 6 > 
we can instead consider the point {l,x/S). 

Definition 5.2 (Buy and wait region). 

For any t G [0,r], we define the inner buy region as 

Brt |y £ (0, cx)) | 3^ G (0, y) : U{t, l,y)^U {t, 1 -I- Ktt 2/ - C) + (^1 + , 

and call the following sets the buy region and wait region at time t: 

BRt := Wt, WRt [0, oo) \ Brt 

(the bar means closure in M). 

The inner buy region at time t hence consists of all values y such that immediate buying at the state 
(1,2/) is value preserving. The wait region on the other hand contains all values y such that any non-zero 
purchase at (1, y) destroys value. Let us note that Brx ~ (0, oo). BRt — [0, oo) and WRt — {0}. 

Regarding Definition 15.21 the following comment is in order. We do not claim in this definition that Brt 
is an open set. A priori one might imagine, say, the set (10, 20] as the inner buy region at some time 
point. But what we can say from the outset is that, due to the splitting argument (see Lemma l4.ip . Brt 
is in any case a union of (not necessarily open) intervals or the empty set. 
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The wait-region/buy-region conjecture can now be formalized as follows. 
Definition 5.3 (WR-BR structure). 

The value function U has WR-BR structure if there exists a barrier function 

c: [0,r] -J> [0,oo] 

such that for aU t e [0,T], 

Brt = (c(t),TO) 

with the convention (cx), oo) := 0. For the value function in discrete time to have WR-BR structure, 
we only consider t G {to,...,iAr} and set c^ (t) = oo for t ^ {to, ...jt^}. 

Let us note that we always have c{T) — 0. Below we will see that it is indeed possible to have c{t) = oo, 
i.e. at time t any strictly positive trade is suboptimal no matter at which state we start. For c{t) < oo, 
having WR-BR structure means that BRtHWRt = {c{t)}. Figure [3] illustrates the situation in continuous 
time. 




Barrier 
c(t) 



T 

Figure 3: Schematic illustration of the buy and wait regions in continuous time. 



Thus, up to now we have the following intuition. An optimal strategy is suggested by the barrier function 
whenever the value function has WR-BR structure. If the position of the large investor at time t satis- 
fies J > c{t), then the portfolio is in the buy region. We then expect that it is optimal to execute the 
largest discrete trade ^ £ (0, x) such that the new ratio of remaining shares over price deviation g^'x^^ is 
still in the buy region, i.e. the optimal trade is 



which is equivalent to 



Notice that the ratio term 



c = 



c{t) 



c{t)5 



1 + Ktc{t) ' 



-€ 



g^Xt( ^® strictly decreasing in i^. Consequently, trades have the effect of 
reducing the ratio as indicated in Figure [31 while the resilience effect increases it. That is one trades just 
enough shares to keep the ratio y below the barrier^ 

In Figure [3] we demonstrate an intuitive case where the barrier decreases over time, i.e. buying becomes 
more aggressive as the investor runs out of time. This intuitive feature however does not need to hold for 
all possible evolutions of K and p as we will see e.g. in Figure 21 



■* Intuitively, tliis implies that apart from a possible initial and final impulse trade, optimal buying occurs in infinitesimal 
amounts provided that c is continuous in t on [0,T). For diffusive K as in Fruth (20fl), this would lead to singular optimal 
controls. 
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Below we will see that the intuition presented above always works in discrete time: namely, the value 
function always has WR-BR structure, there exists a unique optimal strategy, which is of the type 
"trade to the barrier when the ratio is in the buy region, do not trade when it is in the wait region" (see 
Section 16]). In continuous time the situation is more delicate. It may happen, for example, that the value 
function U has WR-BR structure, but the strategy consisting in trading towards the barrier is not optimal 
(see the example in the beginning of Section [7l where an optimal strategy does not exist). However, if the 
illiquidity K is continuous, there exists an optimal strategy, and, under additional technical assumptions, 
it is unique (see Section[7]). Moreover, if K and p are smooth and satisfy some further technical conditions, 
we have explicit formulas for the barrier and for the optimal strategy (see Section [9]). 

5.3 Some properties of the value function and buy and wait regions 

We first state comparative statics satisfied by both the continuous and the discrete time value function. 
The value function is increasing in t,5,x and the price impact coefficient K as well as decreasing with 
respect to the resilience speed function. 

Proposition 5.4 (Comparative statics for the value function). 

a) The value function is nondecreasing in t,6,x. 

b) Fix t G [0,r]. Assume that < Kg < Kg for all s G [t, T]. Then the value function corresponding 
to K is less than or equal to the one corresponding to K . 

c) Fix t G [0,r]. Assume that < Ps l£ Ps for all s G Then the value function corresponding to p 
is less than or equal to the one corresponding to p. 

The proof is straightforward. 

Proposition 5.5 (Continuity of the value function). 
For each t G [0,T], the functions 

C/(t, ■,■): [0,oo)2 ^ [0,oo) and l/(i, •) : [0, oo) -> [0, oo) 

are continuous. 

Proof. Due to Lemma 15.11 it is enough to prove that the function U(t,-,-) is continuous. Let us fix 

t e [0,T], X > 0, < Si < S2, e > and take a strategy 9'^ G At{x) such that 

J(t,(5i,e') < U{t,Si,x) + e. 

For i = 1,2, we define 

Dl ,5,e-^>"''" + / X^e-^-^-^-rfe^, s G [t,T+]. 

J[t,s) 

Using Proposition 15. 4[ we get 

U{t,5,,x)<U{t,52,x)< j^^^^ (^Dl + ^AQl^ dQ\ 

< J^^ {dI + ^Ae:) dQl + {S2 - 5i)x 

= J{t, 5i, e^) + {82 - 5i)x < U{t, 61, x) +€+{52- Si)x. 
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Thus, for each fixed t G [0,r] and a; > 0, the function U{t,-,x) is continuous on [0, oo). For t e [0,T], 
S >0 and a; > 0, by Lemma [5TT1 we have 

U{t,d,x) = x^U{t,5/x,l), 

hence the function U{t, ■, •) is continuous on [0, oo) x (0, oo). Considering the strategy of buying the whole 
position X at time i, we get 

U{t, S, x)<(s+ ^x] X > = U{t, S, 0), 



2 / x\o 

i.e. the function U{t, •, •) is also continuous on [0, oo) x {0}. This concludes the proof. □ 

Proposition 5.6 (Trading never completes early). 

For all t G [0, T), (5 G [0, oo) and x e (0, oo), the value function satisfies 

U{t,6,x) < (^d + X, 

i.e. it is never optimal to buy the whole remaining position at any time t £ [0,T). 

Proof. For e G [0, x], define the strategies 0^ S At{x) that buy {x — e) shares at t and e shares at T. The 
corresponding costs are 

J{t,S,Q^)=(^S+^{x-e)^ (x-e)+ (^(<5 + irt[.T-e])e-/"''='^^ + ^e) e. 
U{t, 6,x)<J {t, 6, e°) = ^(5 + ^x^ X, 



Clearly, 



but we never have equality since 

^J{t,S,e') =-(l-e-f*"p^^'){KtX + S) <0. 

□ 

As discussed above, we always have Brr — (0,oo) and WRt = {0}. In two following propositions we 
discuss Brt (equivalently, WRt) for t e [0,r). 

Proposition 5.7 (Wait region near 0). 

Assume that the value function U has WR-BR structure with the barrier c. Then for any t G [0,T), 
c{t) G (0, oo] (equivalently, there exists e > .such that [0,e) C WRt). 

Proof. We need to exclude the possibility c{t) — 0, i.e. Brt = (0, oo). But if Brt = (0,oo), we get by 
Proposition [53] that for any y > 0, 

v{t,y)= (i + f^y) 

which contradicts Proposition 15.61 □ 
The following result illustrates that the barrier can be infinite. 



16 



Proposition 5.8 (Infinite barrier). 
Assume there exist < ti < t2 < T such that 

K.e^il^ Purf« > joj. all s e [ti,t2). 

Then Bts = for s € [ti,t2). 



In particular, if tlie assumption of Proposition 15.81 fiolds with ti = and t2 = T, then the value function 
has WR-BR structure and the barrier is infinite except at terminal time T. 

Proof. For any s G [ti,t2), S g [0,(X)), x € {0,oo) and Q G As{x) with &t2 > 0, we get the following 
by applying pT|) , the assumption of the proposition, monotonicity of J in 5, and integration by parts as 
in ® 

> / ( Se- P'-'^'' + [ Kre- P^'^^dQr + ^ Ae„ ) dQu 
+ J (t2, (5e- + i^t.e*, , (e„ - &t2)ue[u,T+]) 

That is it is strictly suboptimal to trade on [s, t2). In particular, Br^ = 0. □ 



Proposition 15.81 can be extended in the following way. 

Proposition 5.9 (Infinite barrier, extended version). 

Let K be continuous and assume there exist < ti < t2 < T such that 

Then Br,, 0. 



Proof. Define i as the minimal value of the set 



argmm AfC 

with t being well-defined due to the continuity of K. Then we know that t > ti. By definition of i, we 
have that for all t G [ti,i) 

and hence 

By Proposition 15.81 we can conclude that Brt — for all t G [ti,i) and hence in particular for t — ti. □ 
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6 Discrete time 



In this section we show that the optimal execution problem in discrete time has WR-BR structure. Let us 
first rephrase the problem in the discrete time setting and define Kn '■— Kt^. D„ := Dt^ and ^„ :— A0t^ 
for n — N . The optimization problem (|12p can then be expressed as 



t/^(t„,<5,x)= inf Y.[d, + ^^A^,. (17) 



S^e[o,x] 



with Dn — 5 and -Dj+i — {Dj + Kj^j)aj, where 



3 + 1 



aj exp y J Psds j . (18) 

Recall the dimension reduction from Lemma l5.ll 

U^{t„,d,x)=d'V^ {t„,^) with V^{t„,y):^U''iU„l,y). 

The following theorem establishes the WR-BR structure in discrete time. 
Theorem 6.1 (Discrete time: WR-BR structure). 

The discrete time value function has WR-BR structure with some barrier function c^ . There exists 
a unique optimal strategy, which corresponds to the barrier as described in Section \5.2l Furthermore, 
{t„ , ■) : [0, oo) — )■ [0, oo) has the following properties for n — 0, N . 

(i) H is continuously differentiable. 

(ii) It is piecewise quadratic, i.e., there exists M G N, constants (ai, f3i,"fi)i=i^,,,_M md < j/i < 
j/2 < •■• < 2/M = oo such that 

V^{tn,y) = arr,(y)y'^ + Pm(y)y + lm(y) 

for the index function m : [0, oo) — > {1, A/} with m{y) := mh\{i\y < yi}. 

(Hi) The coefficients (a^, 7^)^=1 m from (ii) satisfy the inequalities 

m, 13^ > 0, (19) 
4aa^ + |3^-|3f > 0, 
yi_i(3, + 27, > 0. 

The properties (i)-(iii) of included in the above theorem will be exploited in the backward induction 
proof of the WR-BR structure. The piecewise quadratic nature of the value function occurs, since the 
price impact D is affine in the trade size and is multiplied by the trade size in the value function (jl7p . 
Let us, however, note that the value function in continuous time is no longer piecewise quadratic. 

We prove Theorem 16.11 by backward induction. As a preparation we investigate the relationship of the 
function at times i„ and tn+i- They are linked by the dynamic programming principle: 



V" (t„, y) = niin 1 + U + U" (t„+i, (1 + Kn^an, 2/ - 
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Instead of focusing on the optimal trade ^, we can alternatively look for the optimal new ratio 77(^) := 
i^^^ ^ of remaining shares over price deviation. Note that t] is decreasing in the trade size ^ and bounded 
between zero (if the entire position is traded at once) and the current ratio y (if nothing is traded). A 
straightforward calculation confirms that (|20p is equivalent to 



V''{tn,y) 



2K„ 



where 



[l + Knvf min L^(i„,?7)-1 



l + 2Kr.alV^{tn+i,rja-^) 



(21) 



(22) 



(1 + i^„7y)2 

Note that in (|2ip the minimization is taken over rj instead of ^. Furthermore, the function depends 
on rj, but not on y or ^ separately. In the sequel, the function will be essential in several arguments. 
The following lemma will be used in the proof of Theorem 16.11 

Lemma 6.2. Let a G (0, 1), k > and let the function v : [0, oo) [0, co) satisfy (i), (ii), (iii) given in 
Theorem \6.1\ Then the following statements hold true. 

(a) There exists c* G [0,oo] such that 



L{y) := 



1 + 2Ka'^v{ya^^) 



y e [0,oo), 



(1 + Ky)2 

is strictly decreasing for y £ [0, c*) and strictly increasing for yd (c*, oo). 
(b) The function 

j-Ai^ + ^y)'Lic*)-i] ^fy>c* 

a'^v{ya ^) otherwise 
again satisfies (i), (ii), (iii) with possibly different coefficients. 



Proof of Theorem \6.1\ We proceed by backward induction. Notice that V^{tN,y) = (l + -^y) y ful- 
fills (i), (ii), (iii) with AI = l,ai ~ Pi = 1, 71 = 0. Let us consider the induction step from t„_|_i to 
We are going to use Lemma [6.21 for a — a„,/t = K^v = {tn+i,-). We then have that L = L^{tn,-) 
and we obtain c* as the unique minimum of L^(tn, •) from Lemma [O (a). From ^ we see that the 
unique optimal value for rj is given by 

r]* := argmin-^ [(1 + Kr^yf {tn,v) - l] = mm {y, c*} 

and accordingly that the unique optimal trade is given by 

r :^a^*)-max(o, ^"f" 1. 

[ 1 + K„Cn J 

Therefore we have a unique optimal strategy and the value function has WR-BR structure with c^(i„) := 
c*. Plugging ^* into ([^0]) and applying the definition of V'^ yields y^(i„,y) — v{y). Lemma (h) now 
concludes the induction step. □ 



Proof of Lemma \6.2l (a) The function L is continuously differentiable with 

L'iy) = j^Avl (23) 

Kv) 2/ (2a„i(j;a-i) - «:/3m(ya-i)a) + (/3m(ya-i)a - 2K7,„(,y„-i)a^ - 1) . 
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First of all, we show that there is no interval where L is constant. Assume there would be an interval 
where I is zero, i.e., there exists i G {l,...,Af} such that (2ai — K/S^a) = and {(3ia — 2Kjia'^ — 1) = 0. 
Solving these equations for a respectively 7 yields 

4a,7i + - = 0. 

This is a contradiction to (|19p. 

Let us assume l{y) > for some y G [0,oo) with j := m{ya^^). We are done if we can conclude 
l{y) > for all y € [y, 00). Because of the continuity of /, it is sufficient to show that L keeps increasing 
on [y,yj], i.e., we need to show l{y) > for all y G [y,yj]- Due to the form of Z, this is guaranteed 
when 2aj — ii(3ja > 0. Let us suppose that this term would be negative which is equivalent to 2aj(3~^a~^ < 
K. Together with the inequalities from (|19p one gets 

al{y) — —Ka (ya^^Pj + 27^) + (2ya^^aj + f3j — a^^) 

< -2ajPJ^ {ya'^P, + 27j) + {2ya-^aj + (3j - a^^) 

= -^(4«j7,+/3ja-i-/?|) <0. 
This is a contradiction to l{y) > 0. 

(b) If c* is finite, the function v is continuously differentiable at c* since a brief calculation shows 
that v'{c*-) = v'{c*+) is equivalent to l{c*) = 0. We have 

i.e. V is piecewise quadratic with M = 1 + m(c*a^^), y]yj_i '■— c*, jji :— yia for i ~ 1, A/ — 2 and 

5m = > 0, ^ L{c*) > 0, 7,7 ^ ^^^2" ^ (24) 

ai = > 0, /3i = a/3j > 0, = 0^7^ for i = 1, M - 1. 

We therefore get 

A~ ~ . 3 B2 ( if i = M 1 ^ „ 

[ (4Q;i7i + a Pi — p^j otherwise J 

It remains to show that v also inherits the last inequality in (|19p from u. For y < c* , 

yPm(y) + 27rn(a) = ^/3m(ya- 1 ) + 27TO(yQ-i)) > 0. 

Due to V being continuously differentiable in c*, we get 

2a^^c + = 2Q:jy7_;^c +/3m-i- 
Taking two times the first equation and subtracting c* times the second equation yields 

c*Pm + 27Af = c*^M-i + 27M_r 
Since we already know that the right-hand side is positive, also y/^M + 27^7 > for all y > c* . □ 
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We need the following lemma as a preparation for the WR-BR proof in continuous time. 
Lemma 6.3. Let K be continuous. Then at least one of two following statements is true: 

• The function y ^ L^{0,y) is convex on [0,c^(0)); 

• The continuous time buy region is simply Brg = %, i.e. c(0) = oo. 

We stress that the first statement in this lemma concerns discrete time, while the second one concerns 
the continuous time optimization problem. 

Proof. Recall that the definition of {0, •) from ([22| contains V^{ti, •) which is continuously differen- 
tiable and piecewise quadratic with coefficients {ai, Analogously to ([23]), it turns out that 



dy (l + Koyr 



We distinguish between two cases. First assume that alH satisfy (2a,-KQl3,e~ J'o' p^'^") > 0. Then ^^^(0, •) 
must be increasing on [0,c^(0)) as desired, since £^(0, •) is decreasing on this interval as we know from 
Lemma [ 



Assume to the contrary that there exists i such that {2ai — Ko(3ie~-^o^ psds-^ ^ q j^gj^^U how ai and /3i 
are actually computed in the backward induction of Theorem 16. II In each induction step. Lemma 16.21 is 
used and the coefficients aj^,j,/3j^ get updated in (P^ . It gets clear that there exists n G {!,..., A^} such 
that 

2a, - Ko^e~I»' "^^^ = - Koe- lo" p^^s^j {t^^c"" [t,,)) . 

We get the resilience multiplier Jo" p^*^^ thanks to the adjustment Pi = aj3i from the second line of ([M)) . 
Due to being positive, it follows that 

That is for this choice of K, it cannot be optimal to trade at i = as we see from Proposition [521 Hence, 
the buy region at t = is the empty set for both discrete and continuous time. □ 



The proof of Theorem 16.11 is constructive. It not only establishes the existence of a unique barrier, but 
also provides means to calculate the barrier numerically through the following recursive algorithm. 



Initialize value function V^{tN,y) = (l + -^y) y 
For n = N ~1,...,0 

bet 7^ [tn,y) ■- ii+K„yf 

Compute [tn) '.= Cn '■— argmin L^(i„, y) 

y>Q 



Set V^{tr.,y) 



^[{l + K^yfL'^it.^Cn)-!] if y>c„ 
a'^V^ {tn+i,ya~^) otherwise 



21 



We close this section with a numerical example. Figure |4] was generated using the above numerical scheme 
and illustrates the optimal barrier and trading strategy for several example definitions of K and p. For 
constant if, we recover the Obizhaeva and Wang (2006) "bathtub" strategy with impulse trades of the 
same size at the beginning and end of the trading horizon and trading with constant speed in between. 
The corresponding barrier is a decreasing straight line as we will explicitly see for continuous time in 
Example 19.51 For high values of the resilience p, the barriers have the typical decreasing shape, i.e. the 
buy region increases if less time to maturity remains. For low values of the resilience p. the barrier must 
not be decreasing and can even be infinite, i.e. the buy region is the empty set, as illustated for with 
less liquidity in the middle than in the beginning and the end of the trading horizon. 



7 Continuous time 



We now turn to the continuous time setting. In Section [7.1l we discuss existence of optimal strategies using 
Helly's compactness theorem and a uniqueness result using convexity of the value function. Thereafter in 
Section 17.21 we prove that the WR-BR result from Section [5] carries over to continuous time. 



7.1 Existence of an optimal strategy 



In continuous time existence of an optimal strategy is not guaranteed in general. For instance, consider 
a constant resilience pt = p > Q and the price impact parameter K following the Dirichlet-type function 

r 1 for t rational 1 , 
* 1^ 2 for i irrational J ' 

In order to analyze model ([25]), let us first recall that in the model with a constant price impact Kt = 
K > there exists a unique optimal strategy, which has a nontrivial absolutely continuous component 
(see Obizhaeva and Wang (2006) or Example 19 . 51 below for explicit formulas). Approximating this strategy 
by strategies trading only at rational time points we get that the value function in model \2b\ coincides 
with the value function for the price impact Kt = 1. But there is no strategy in model (|25p attaining this 
value because the nontrivial absolutely continuous component of the unique optimal strategy for Kt = 1 
will count with price impact 2 instead of 1 in the total costs. Thus, there is no optimal strategy in 
model 

We can therefore hope to prove existence of optimal strategies only under additional conditions on the 
model parameters. In all of Section [7] we will assume that K is continuous; the following theorem asserts 
that this is a sufficient condition for existence of an optimal strategy. 

Theorem 7.1. (Continuous time: Existence). 

Let K : [0,r] — >■ (0,cxd) he continuous. Then there exists an optimal strategy Q* £ At{x), i.e. 

J(t,S,Q*)^ inf J{t,5,e). 



In the proof we construct an optimal strategy as the limit of a sequence of (possibly suboptimal) strategies. 
Before we can turn to the proof itself, we need to establish that strategy convergence leads to cost 
convergence. 

^Let us, however, note that the value function here has WR-BR structure with the barrier from Example 1 9 . 5 1 wit h k = 1. 
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Low Resilience ffigh Resilience 




0.0 0.2 0.4 0.6 0.8 1.0 0.0 0.2 0.4 0.6 0.8 1.0 



Figure 4: Illustration of the numerically computed barrier (c^(f„))„=o,...,]v and the corresponding optimal 
strategy (A0t„)n=o,...,]v in discrete time for T = 1, A'' = 10, a:: = 100, 5 = 0, p — 2 (left-hand side) and p = 10 
(right-hand side). We used = 0.7, Kt = 1 - 0.6t and Kf ^ 1 - 2A{t - 0.5)^ as the given evolution of the 
illiquidity. 
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Proposition 7.2. (Costs are continuous in the strategy, K continuous). 

Let K : [0,T] (0, oo) he continuous and let G), (O") be strategies in At{x) with 6" ^ e, i.e., 
lim„^oo 0" — ©s for every point s G [t,T] of continuity of Q (i.e. 0" converges weakly to Q). Then 

I J{t, 6, 9) - J{t, ,5, 9") I > 0. 



Note that Proposition 17.21 does not hold when K has a jump. To prove Proposition 17. 2[ we first show 
in Lemma 17.31 that the convergence of the price impact processes follows from the weak convergence of 
the corresponding strategies. We then conclude in Lemma [7.51 that Proposition 17.21 holds for absolutely 
continuous K. This finally leads to Proposition 17.21 covering all continuous K. 

Lemma 7.3. (Price impact process is continuous in the strategy). 

Let K : [0,r] (0,cxd) he continuous and let 9, (9") he strategies in At{x) with 9" 4 9. 
Then lim„_j.oo -D" = Dg for s = T+ and for every point s G [t, T] of continuity of 9. 



Proof. Recall equation pT|l 



which holds for s = T+ and s G [t, T]. Due to the weak convergence (note that the total mass is preserved, 
i.e. 9t+ — Qt+ — since 9,9" G At{x)) and the integrand being continuous in u, the assertion 
follows for s — T+. Due to the weak convergence we also have that for all s G [t,T] with AQg — 
and /s(w) := K^e^ '''■'^''/[(^s) (it) (i.e. fs is continuous d9-a.e.) 



t,T] 



fs{u)dei + 6e-f^'p-''^ 



^ / fsiu)de^+Se-f>-^'' 

= J[t,T] 



Ds 



Lemma 7.4. (Costs rewritten in terms of the price impact process). 

Let K : [0,r] —5- (0,cxd) he absolutely continuous, i.e. Ks = Kq + Jj^ ^^du. Then 



J{t,S,&)^- 



Kt Kt 



t,T] 



□ 



(26) 



Proof. Applying 
yields 



,^ dDs+PsDsds AD, 
a9,, = , A9, = 



Ks 



It-T] 



Ds 



Ks 



-A9, dQ 



Ds + iAD, 

— 2 tdDs 

Ks 



Ks 



ds 



^ADsPsDs 



ds. 



'[t,T] J^s -Jlt-T] "'[t,T] J^s 

In this expression, the last term is zero since D has only countably many jumps. Using integration by 
parts for caglad processes, namely P^)) with U :— D, V := ^, and d (^"^^ = -^dDg +Dsd (^7^)1 '^^ can 



write 



[t.T] 



Ds , 1 
—dDs = - 
Ks 2 
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Plugging in d [-j^] = —-^ds yields as desired. □ 



The following result is a direct consequence of Lemma 17.31 and Lemma 17.41 
Lemma 7.5. (Costs are continuous in the strategy, K absolutely continuous). 

Let K : [0, T] (0, oo) be absolutely continuous and Q, (0") be strategies in At{x) with 0" —> Q. Then 

I J{t, 6, 9) - J{t, 6, 9") I > 0. 

n— >oo 

Proof of Proposition \7.2l We use a proof by contradiction and suppose there exists a subsequence [rij ) C N 
such that 

hm / (d^^ + ^A&A de^' ^ f (d, + ^Ae^ dSs, 

3^°°J[t,T] \ ^ J J[t,T] \ ^ J 

where the limit on the left-hand side exists. Without loss of generality assume 

lim / (D:^+^A&AdQ'l^<[ (Ds + ^Ae,)des. (27) 

l^°°J[t.T] \ ^ J J[t.T\ \ ^ J 

We now want to bring Lemma 17.51 into play. For e > 0, we denote by K*^ : [t, T] — > (0, cxo) an absolutely 
continuous function such that max<,g[f j^j \Kl — Ks\ < e. For 9 G At{x) 

Dl + ^AQ.}\ d9,, - f (d., + ^A9., 1 dQ.. 



[t.T] V 2 / J[t.T] 

< J^^ (^\Dl - Ds\ + i \Kt - i^.l A9,^ dOs < ^xh. 
We therefore get from ([57]) that there exists e > such that 

limsup / fe-^ + ^AqA d9:^ < [ (dI + ^AQs] dS^. 

i^oo J[t,T] V ^ J J[t,T] V ^ / 

This is a contradiction to Lemma 17.51 □ 
We can now conclude the proof of the existence Theorem 17. II 



Proof of Theorem 1 7. 1[ Let (9") C At{x) be a minimizing sequence. Due to the monotonicity of the 
considered strategies, we can use Helly's Theorem in the form of Theorem 2, §2, Chapter III of Shiryaev 
(1995), which also holds for left-continuous processes and on [t,T] instead of (— cxd, oo). It guarantees the 
existence of a deterministic 9 € At{x) and a subsequence (n^) C N such that (9"^) converges weakly 
to 9. Note that we can always force 9t+ to be x, since weak convergence does not require that 9j.^ 
converges to 9t whenever 9 has a jump at T. Thanks to Proposition 17.21 we can conclude that 



U{t, S, x) = lim J(t, (5, 9"^ ) = J(i, S, 9). 



□ 



The price impact process D is afRne in the corresponding strategy 9. That is in the case when K is not 
decreasing too quickly. Lemma 17.41 guarantees that the cost term J is strictly convex in the strategy 9. 
Therefore, we get the following uniqueness result. 
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Theorem 7.6. (Continuous time: Uniqueness). 

Let K : [0,T] (0,oo) he absolutely continuous, i.e. Kg = Kq + fiudu, and additionally 

fXs + 2psKs > a.e. on [0,r] with respect to the Lebesgue measure. 
Then there exists a unique optimal strategy. 



7.2 WR-BR structure 



For continuous if, we have now established existence and (under additional conditions) uniqueness of the 
optimal strategy. Let us now turn to the value function in continuous time and demonstrate that it has 
WR-BR structure, consistent with our findings in discrete time. 

Theorem 7.7. (Continuous time: WR-BR structure). 

Let K : [0,T] — > (0,oo) be continuous. Then the value function has WR-BR structure. 



We are going to deduce the structural result for the continuous time setting by using our discrete time 
result. First, we show that the discrete time value function converges to the continuous time value function. 
Without loss of generality, we set i = 0. 

Lemma 7.8. (The discrete time value function converges to the continuous time one). 

Let K : [0,r] — ?• (0, cxd) he continuous and consider an equidistant time grid with N trading intervals. 

Then 

lim l/^(0,y) = F(0,y). 



Proof. Thanks to Theorem 1 7.11 there exists a continuous time optimal strategy Q* G Ao{y). Approximate 
it suitably via step functions e (y). Then 

V{0,y) = J(0, l,e*) = lim J(0,l,e^) > limsupP"^(0,2/). 
The inequality V^(0, y) < liminfjv_>oo V^^(0, y) is immediate. □ 



Proof of Theorem 17. 71 By the same change of variable from ^ to that was used in Section [6l we can 
transform the optimal trade equation 

V{0, y) = min^ + C + (1 + Ko^^V (o,-^~^ 



into the optimal barrier equation 

1 



2/) 



2Ko 
where 



{1 + Koyf min L(0,?7) - 1 

v&lO,y] 



Now it follows from (1281) and (1291) that 



min i(?7) = L(y), 



(28) 
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in particular the function L is nonincreasing in y. Define 



L^(2/):= min L^(0,,7), 
';e[o,a] 

which is a nonincreasing positive function. If for some N the function y i— L^{0,y) is not convex on 
[0, c^(0)), then the second alternative in Lemma [^31 holds . i.e. we have WR-BR structure with c(0) = cxd. 
Thus, below we assume that for any N the function y M> L^{0,y) is convex on [0,c^(0)), hence, by 
Lemma |6^ (a) and Theorem 16. 11 the function is convex on [0, oo). Moreover, by rearranging pT|) we 
obtain that 

l + 2KoV^{0,y) 



Hence L converges pointwise to L as — > oo by Lemma 17.81 and 



(1 + Koyf 



Therefore, L is also convex. 



Due to L being nonincreasing and convex, there exists a unique c* 6 [0, oo] such that L is strictly decreasing 
for y € [0,c*) and constant for y G (c*,oo). One can now conclude that for all y > c* and ij € {c*,y), 
setting ^ := jf^, i.e. i] = jf^, and using ^ and L{y) ^ L{r]), we have 



ViO,y) 



1 



2Ko 
1 

1 

2i^o 



[{l + KoyfL{y)-l] 
[{1 + Koyfm-l] 



(1 + KoyfL 



1 + m 



- 1 



We now use the definition of L from ([^H) once again to get 



^(0, 2/) - ( 1 + f^c) e + (1 + KoO'V (^0, ^^-^ 



(30) 



Therefore (c*, oo) C Brg. In case of c* > 0, consider y < c* , take any 77 g [0, y), and set ^ := j^^^. Then 
a similar calculation using that L{y) < L{ri) shows that F(0, y) is strictly smaller than the right-hand side 
of ([50]) . Hence i?ro = (c*, 00). Thus, we get WR-BR structure with c(0) = c* G [0, 00] as desired. □ 



In Section ^ we will investigate the value function, barrier function and optimal trading strategies for 
several example specifications of K and p. 



8 Zero spread and price manipulation 

In the model introduced in Section [21 we assumed a trading dependent spread between the best ask At 
and best bid Bt . This has allowed us to exclude both forms of price manipulation in Section |3l An 
alternative assumption that is often made in limit order book models is to disregard the bid-ask spread 
and to assume At = Bt, see, for example, Huberman and Stanzl (2004), Gatheral (2010), Alfonsi, Schied, 
and Slynko (2011) and Gatheral, Schied, and Slynko (2011b). The canonical extension of these models to 
our framework including time- varying liquidity is the following. 

Assumption 8.1. In the zero spread model, we have the unaffected price S*", which is a cadlag 'H^- 
martingale with a deterministic starting point Sq, and assume that the best bid and ask are equal and 
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given by Af = Bf = + Df with 

^ Die' ^0 ds _^ f Kse~^>"'^''{des-des), t e [0,T+], (31) 

where Dq S R is the initial value for the price impact. For convenience, we will furthermore assume that 
K : [0, r] (0, oo) is twice continuously differentiable and p: [0,T] (0, oo) is continuously differentiable. 

As opposed to this zero spread model, the model introduced in Section [5] will be referred to as the dynamic 
spread model in the sequel. In this section we study price manipulation and optimal execution in the zero 
spread model. In particular, we provide explicit formulas for optimal strategies. This in turn will be used 
in the next section to study explicitly several examples both in the dynamic spread and in the zero spread 
model. 

We have excluded permanent impact from the definition above (7 = 0). It can easily be included, but, 
like in the dynamic spread model, proves to be irrelevant for optimal strategies and price manipulation. 
Note that for pure buying strategies {Q = 0) the zero spread model is identical to the model introduced 
in Section [21 The difference between the two models is that if sell orders occur, then they are executed 
at the same price as the ask price. Furthermore, buy and sell orders impact this price symmetrically. 
We can hence consider the net trading strategy 8^ := — 8 instead of buy orders 8 and sell orders 8 
separately. The simplification of the stochastic optimization problem of Section 12.21 to a deterministic 
problem in Section |4] applies similarly to the zero spread model defined in Assumption 18.11 Thus, for any 
fixed a; € M, we define the sets of strategies 

-.^ {Q^ : [0, T+] M I 8^ is a deterministic caglad 
function of finite variation with 80 = 0}i 
A^{x) |8^ e A^ I 8^,+ = . 

Strategies from A^{x) allow buying and selling and build up the position of x shares until time T. We 
further define the cost function J-l- : M x — R as 

J^(8^) := J(<5, 8^) := + ^A8|) de|, 

where D-^ is given by (pT|) with Dq = S. The function J-^ represents the total temporary impact cost^ 
in the zero spread model of the strategy on the time interval [0, T] when the initial price impact 
Dq = S. Observe that is well-defined and finite because K is bounded, which in turn follows from 
Assumption 18.11 The value function JJ-t : — ^ R is then given as 

U^{6,x):= inf J^((5,8^). (32) 

The zero spread model admits price manipulation if, for — 0, there is a profitable round trip, i.e. there 
is 8-'- G yl~^(0) with J^{0, Q^) < 0. The zero spread model admits transaction-triggered price manipulation 
if, for Dq = 0, the execution costs of a buy (or sell) program can be decreased by intermediate sell 
(resp. buy) trades (more precisely, this should be formulated like in Definition 13.21) . 

^In the case of liquidation of shares (i.e. < 0) the word "costs" should be understood as "minus proceeds from the 

liquidation". 
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Remark 8.2. The conceptual difference with Section[3]is that we require = in these definitions. The 
reason is that even in "sensible" zero spread models (that do not admit both types of price manipulation 
according to definitions above), we typically have profitable round trips whenever Dq =/= 0. In the zero 
spread model, the case Dq ^ can be interpreted as that the market price is not in its equilibrium state 
in the beginning. In the absence of trading the process (-Dj ) approaches zero due to the resilience, hence 
both best ask and best bid price processes (^f ) and (b\) (which are equal) approach their evolution in 
the equilibrium (S""). The knowledge of this "direction of deviation from 5"" plus the fact that both buy 
and sell orders are executed at the same pric^ll clearly allow us to construct profitable round trips. For 
instance, in the Obizhaeva- Wang-type model with a constant price impact A't = k > 0, the strategy 

X 

e|:=-f^^/(o,e](s), se[0,T+], 

where e G (0,T], is a profitable round trip whenever _Dq ^ 0, as can be checked by a straightforward 
calculation. 



Let us first discuss classical price manipulation in the zero spread model. If the liquidity in the order 
book rises too fast (K falls too quickly), then a simple pump and dump strategy becomes attractive. In 
the initial low liquidity regime (high K) , buying a large amount of shares increases the price significantly. 
Quickly thereafter liquidity increases. Then the position can be liquidated with little impact at this 
elevated price, leaving the trader with a profit. The following result formalizes this line of thought. 

Proposition 8.3. (Price manipulation in the zero spread model). 
Assume the zero spread model of Assumvtion [Kl\ and that 

K[ + 2ptKt < for some t G [0, T). 

Then price manipulation occurs and, for any d,x gS., there is no optimal strategy in problem p2l) . 



Proof. By the assumption of the theorem, 

K[ = hm * < ~2ptKt = lim ^ ^ , 

c\,o e c\o e 

hence for a sufficiently small e > we have 

< if* (2e-J'^' l). (33) 

Let us consider the round trip Q^"^ G ^'''(0), which buys 1 share at time t and sells it at time t + e, i.e. 

e|™ (s), sG[0,T+]. 

A straightforward computation shows that, for = 0, the cost of such a round trip is 

j$(o, e^™) = ^i±li±i Kte- f^' 

Due to (IMl), J^(0, 6^") < 0. Thus, price manipulation occurs. 



^Let us observe that this does not apply to the dynamic spread model of Section [2] where we have different processes D 
and E for the deviations of the best ask and best bid prices from the unaffected ones due to the previous trades. 
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Let us fix 6,x £ M, consider a strategy 8-1- G A^ix), and, for any z e M, define 

Qt^ := + ze>\ 

Then e A^{x) and we have 

with Co = J-''(0, B-f™) < and some constants ci and C2- Since z is arbitrary, we get U'^{5,x) = —00. 
An optimal strategy is this situation would be a strategy from A^{x) with the cost —00. But for any 
strategy 0-1-, its cost J'^{5,Q'^) is finite as discussed above, hence there is no optimal strategy in prob- 
lem □ 

Interestingly, the condition Kf+2ptKt < for some t in Proposition IS . 3l is not symmetric; quickly falling K 
leads to price manipulation, but quickly rising K does not. 

If A'j + 2ptKt > holds at all points in time, then the situation remains unclear so far. In their model, 
Alfonsi, Schied, and Slynko (2011) and Gatheral, Schied, and Slynko (2011b) have shown that even in the 
absence of profitable round trip trades, we might still be facing transaction-triggered price manipulation. 
This can happen also in our zero spread model. The following theorem provides explicit formulas for 
optimal strategies and leads to a characterization of transaction-triggered price manipulation. 

Theorem 8.4. (Optimal strategies in the zero spread model). 

Assume the zero spread model of Assumvtion [Kl\ and that K[ + 2ptKt > on [0,T]. Define 



(35) 



Then, for any 5,x dW, the strategy Q^* given by the formulas 
with (5^ i (^x + -j^^ and 

^ ft + Ptft , fa , 1 ^ /t ^ n /Q^-N 
— f^^*+Xo+^'^'' ^''^ 
is the unique optimal strategy in problem (j32p . Furthermore, we have 

uHs, X) = j^(., e^) = i6tf (^J\k + 2p,K,)^, + ^) - 4- ^''^ 

Corollary 8.5 (Transaction-triggered price manipulation in the zero spread model). 
Under the assumptions of Theorem \8.4\ price manipulation does not occur. Furthermore, transaction- 
triggered price manipulation occurs if and only if fo < or // -I- ptft < for some t G [0, T] . 



Proof. Using ((35| with 5 — 0, we immediately get that price manipulation does not occur. Noting further 
that /t < 1, we obtain that transaction-triggered price manipulation occurs if and only if either /q < 
or fl + Ptft < for some t e [0,T]. □ 
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We can summarize Proposition IS . 31 and Corollary [83] as follows. If K[ + 2ptKt < for some t, i.e. liquidity 
grows very rapidly, then price manipulation (and hence transaction-triggered price manipulation) occurs. 
li K^ + 2ptKt > everywhere, but /o < or fl + ptft < for some t, i.e. liquidity grows fast but not quite 
as fast, then price manipulation does not occur, but transaction-triggered price manipulation occurs. If 
K'f + 2ptKt > everywhere, fo >Q and // -I- ptft > everywhere, i.e. liquidity never grows too fast, then 
neither form of price manipulation occurs and an investor wishing to purchase should only submit buy 
orders to the market. Figure [5] illustrates optimal transaction-triggered price manipulation strategies. In 
Example 1, the liquidity is slightly growing at the end of the trading horizon, which makes the optimal 
strategy O-t* non-monotonic. As we see in Example 2, the number of shares hold by the large investor 
can become negative although the overall goal is to buy a positive amount of shares. 



Example 1 



Example 2 
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\ ; 
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Figure 5: In Example 1, we consider Kt — sin(2.5t) + 0.1 and Kt = sin(lOt) -I- 4 in Example 2. The other 
parameters are T = 1, p = 2, x = 100, 5 = 0. The plots at the bottom illustrate the corresponding optimal 
strategies e** from p5l). 



In the proof of Theorem 18.41 we are going to exploit the fact that there is a one-to-one correspondence 
between Q-^ and D^. We rewrite the cost term, which is essentially D^dQ'^, in terms of the deviation 
process by applying 



, ^ dDl + p^ 
and get the following result. 

Lemma 8.6 (Costs rewritten in terms of the price impact process). 



(38) 
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Under Assumption ] 8. 1\ for any S G 



and G A^, we have 

2 



D: 



Kt 



— + / {K[ + 2ptKt] 

[0,T] 



dt 



(39) 



The formal proof, where one needs to take into account possible jumps of is similar to that of 
Lemma 17.41 

Similar to Bank and Becherer (2009) and as explained in Gregory and Lin (1996), we can then use the 
Euler-Lagrange formalism to find necessary conditions on the optimal D^. Under our assumptions, these 
conditions turn out to be sufficient and the optimal directly gives us an optimal Q^. Unfortunately, 
we cannot use the Euler-Lagrange approach directly in the full generality of all strategies in ^-t, but need 
to impose a continuity property. Motivated by the WR-BR structure established in previous sections as 
well as the optimal strategy in the case of constant K from Obizhaeva and Wang (2006), we introduce, 
for x G M, the set of strategies ^^^"^(2;) C ^{x) with impulse trades at t = and t = T only: 

A^^ix) := {e^ G A^{x) I is continuous on (0,r)}. 

We will also need a notation for a similar set of monotonic strategies, i.e., for y G [0,oo), we define 

-^oiy) £ A(j/) I is continuous on (0,T)}. 

Lemma 8.7. (Approximation by continuous strategies). 

Assume the zero spread model of Assumption [8A[ Then, for any (5, a; G M, 



U^{5,x) 



inf J^(6,eh^ inf J^(S,Qh. 



(40) 



Proof Let us take any 6^ G A^{x) and find 8, 6 G ^lo such that 6^^ = 9 - 9. We set y := 9t+ G [0, 00), 
y :~ 9t+ G [0, 00), so that x — y ~ y. Below we will show that 

3 9" G A^oiy), 0" e A^oiy) such that 9" 9, 9" ^ 9. (41) 

Let us define Q> 9" - 9" G A^^x). It follows from §^ and the weak convergence of the strategies 
that the price impact Z?f" corresponding to 9-I-" converges to the price impact corresponding to Q-^ 
for t = T-'r and for every point t G [0,T], where both 9 and 9 are continuous (i.e. the convergence of 
price impact functions holds at T+ and everywhere on [0,T] except at most a countable set). By ([M)) . 
we get J^{S, 9-1-") J-^{S, Q^) as n cx). Since 9$ G A^ix) was arbitrary, we obtain ([^0]) . 

It remains to prove ((4T|) . Clearly, it is enough to consider some 9 G Ao{y) and to construct 9" G .4§(j/) 
weakly convergent to 9. Let P denote the class of all probability measures P on {[0,T], B{[0,T])) and 

r''= {Pe V\Pi{s}) = for all s G (0,T)} . 

The formula P([0,s)) ^, s g [G,T], with 9 G Ao{y), provides a one-to-one correspondence be- 
tween Ao{y) and V, where -4g(j/) is mapped on T"^. Thus, it is enough to show that any probability 
measure P £ V can be weakly approximated by probability measures from V^. To this end, let us 
consider independent random variables -0 and C, such that Law('!/') = P and Law((^) is continuous. For 
any n G N, we define 

+ AT. 
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Then 

and Qn —> P as n ^ oo because ^jJn — >■ "0 ^--S- This concludes the proof. 
Lemma 8.8. Assume K[ + 2ptKt > on [0,T] and define 

ft rl 



Xit) 



ls_+_Psfs_,^ , fo_ ^ - ft 

Ko Kt 



Then x{t) > for all t G [0,r]. In particular, c — x{T) > 0. 
Proof. We have 



X(0) 



> 0. 



Furthermore, 



+ 



Ko 

~f[Kt - (1 - ft)Ki 
K? 



> 0. 



□ 



□ 



Proof of Theorem \8.4\ We first note that c from ([55]) is strictly positive by Lemma Also note that if 
an optimal strategy in ([5^ exists, then it is unique in the class A^{x) because the function O-t i-> J^{5, 8^) 
is strictly convex on (this is due to ([5^ and the assumption K[ + 2ptKt > on [0,T]). 



For the strategy O-^* given in we have 



T+ 



as desired. This follows from the formula for 6"^. 



Let us further observe that 8^* corresponds to the deviation process 



dI*=5, d}* =S^ ft on iO,T], D% = S^, 



(42) 



which immediately follows from 
ward calculation gives 



(direct computation using (|3ip is somewhat longer). A straightfor- 



^ ,f't+Pift,, , /o' , l-fT 



Kt 



-dt- 



2Ko 2Kt 



2Ko 



(43) 



Using integration by parts we get 

'""^ ft ft 
Kt 



dt = 



1 


"/I 


fo I 


rT r2 


2 


Kt 


Ko ^ 





Substituting this into (|43)) we get that J'''((5, 8'''*) equals the right-hand side of 



It remains to prove optimality of Q-^* . Due to Lemma 18.71 it is enough to prove that Q^* is optimal in the 
class A'^'^{x), which we do below. In terms of D^*, the corresponding trading costs are 



J{0,T) 



(0,T) 



£1 

Kt 



-dDi 



pt{D}y 



(0,T) 



Kt 



dt- 



t*\2 



2Ko 



2Kt 
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Let us now look at alternative strategies 6 e ^'^{x) with corresponding D = D^* + h and show that 
these alternative strategies cause higher trading costs than @^*. That is in the following, we work with 
functions h: [0.r+] — ;> R, which are of bounded variation and continuous on (0,T) with ho = 0, hx = 
liuityT ht and a finite limit /io+ (so that there are possibly jumps {ho+ — ho), (/it+ — hx) G R). Using 

AOo = Ae> + ^, dQ, = dQt + ^h±Ei!^, A@T = Aer + ^^i±^, 



T 



a straightforward calculation yields 

= J^{S, e$*) + AJi+AJ2, 
AJi := / dt + / —dDt + / -f^dht + + ^ — 



AJ,:=/ + 

(0,T) -"-t 



/ 



[ h. 

J{0,T) 


dof + 


/ ^< 

"'(0,T) -^t 








1 — H 

2/i:o 


^ 2Kt 



Notice that we collect all terms containing D^* in A Ji. We are now going to finish the proof by showing 
that A Ji = and A J2 > if /i does not vanish. 

Let us first rewrite A Ji exploiting the fact that dJ* = S^ft, use integration by parts, the definition of / 
and again integration by parts to get 

AJi 

'^flllhldt+ I —dft+ f ' •^°'^°+ ' ^T+'frhT 



st\f 'J^dt+f ^df,+ f Arf,, + M2± + 

\j(_0,T) Kt Kt J{0,T) Kt 



Kt 



l,T) 



St I I P^dt+I - 



'(o,T) Kt J{o,T) Kt Ko Kt j 

Clearly, A Ji = whenever 6^ = 0. If (5^ ^ 0, we have 

X = [ rfSt + AGo + AeT 

der + Ae> + Ae>] + (f '-^dt+ f ^df'. + ^ + '-^^] 

(0,T) J \J(0,T) 7(0,T) J^t Ko Kt J 

AJi 

= ^+^- 

Therefore A Ji = 0. Hence, J'^iS, 6) — J^{6, 0-1-*) = A J2. Applying integration by parts to the dht integral 
yields 



34 



Due to the assumption K'^ + 2ptKt > on [0,r], we get that AJ2 is positive as desired. □ 



9 Examples 

Let us now turn to exphcit examples of dynamics of the price impact parameter K and the resihence p. We 
can use the formulas derived in the previous section to calculate optimal trading strategies in problem (|32ll 
in the zero spread model. We also want to investigate optimal strategies in problem (|12p in the dynamic 
spread model introduced in Section [5] In we considered a general initial time t G [0, T]. Without loss 
of generality below we will consider initial time for both models, e.g. we will mean the function C/(0, •, •) 
when speaking about the value function in the dynamic spread model. Further, in the dynamic spread 
model we had a nonnegative initial value S for the deviation of the best ask price from its unaffected level 
and considered strategies with the overall goal to buy a nonnegative number of shares x. That is, we 
will consider S,x G [0, 00) in this section when speaking about either model. It is clear that strategy ([55)1 
is optimal also in the dynamic spread model whenever it does not contain selling. Thus, Theorem 18.41 
applied with d,x G [0, 00), provides us with formulas for the value function and optimal strategy also 
in the dynamic spread model whenever there is no transaction-triggered price manipulation in the zero 
spread model (see Corollary 18. 5p and S is sufficiently close to (so that A0q* given by the first formula 
in (I35p is still nonnegative). Furthermore, in this case we get an explicit formula for the barrier function 
of Definition [ 



Proposition 9.1. (Closed form optimal barrier in the dynamic spread model). 

Assume the dynamic spread model of Section\^ and that K: [0,T] (0,cxd) is twice continuously differ- 
entiable and p: [0,T] — > (0, 00) is continuously differentiable. Let 

K[ + 2ptKt > on [0, T], /o > and f[ + ptft > on [0, T], (44) 

where f is defined in (|34p . Then the barrier function of Definition \5.3\ is explicitly given by 



^f's+Psfs, l-fT 



ds + , te[0, T), ciT) = 0. (45) 



Furthermore, for any x e [0, 00) and (5 G 0, , there is a unique optimal strategy in the prob- 
lem U{0,d,x) (see ) and it is given by formula ([55)1 in Theorem \8.4[ and the value function U{0,d,x) 
equals the right-hand side of (j37p . 

Remark 9.2 (Comments to (gS])). 

i) First let us note that (pij) implies /t > on [0, T] (see Lemma [^751 below) . Hence the right-hand side 
of (gS]) has the form a/b with a > (note that /t < 1) and 6 > 0, i.e. c{t) G (0, 00] for t e [0,r). 
The case c{t) = 00 can occur (see e.g. Example 19.61 with 1/ — —1). 



ii) Let us further observe that 



i.e. the barrier always jumps at T. 



linic(t) = i— ^e(0,oo], 



Proof of Proposition \9.1[ Let us first notice that c from ([55]) is strictly positive by Lemma 18.81 so that 
Theorem 18.41 applies. Further, it follows from that in the zero spread model with such functions K 
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and p there is no transaction-triggered price manipulation. Hence, for any a; > 0, the optimal strategy Gr^* 
from ([55)1 with (5 = in the problem J7-'-(0, x) will also be optimal in the problem U (0, 0, x). Let us recall 

that the value c(0) of the barrier is the ratio ° for the optimal strategy &^* in the problem U (0, 0, x) 
and the corresponding D-^* (with of* = 0). Thus, we get 



A similar reasoning applies to an arbitrary t e [0,r). Recall that we always have c(T) = 0. Finally, 
for (5 > 0, under condition (H^ . formula (pSj) for the zero spread model will give the optimal strategy in 
the problem U{0, S, x) (i.e. for the dynamic spread model) if and only if A0g* > 0. Solving this inequality 
with respect to S we get 5 < (note that S'^ from (|35p also depends on 5). □ 



Condition (|44| ensures the applicability of Theorem 18.41 and additionally excludes transaction-triggered 
price manipulation in the zero spread model (see Corollarv l8.5p . The following result provides an equivalent 
form for this condition, which we will use below when studying specific examples. 

Lemma 9.3 (An equivalent form for condition (jH])). 

Assume that K : [0,T] — (0, oo) is twice continuously differentiable and p: [0,T] — > (0,oo) is continuously 
differentiable. Then condition (I44p is equivalent to 

K't -f pti^t > on [0, T] and f[ + ptft>0 on [0, T] . (46) 



Proof. Clearly. implies (|44p . Let us prove the converse. Suppose pi)) is satisfied and K'^ + PsK^ < 
for some s G [0, T]. Then there exists [u,v] C [0, T] such that u < v, /u = and ft < on {u,v]. By the 
mean value theorem, there exists w G {u,v) such that f^ = {fy — fu)/{v — u). Thus, we get < and 
/u, < 0, which contradicts the condition /j -I- pt/t > on [0, T]. □ 



When we have transaction-triggered price manipulation in the zero spread model, optimal strategies in 
the dynamic spread model are different from the ones given in Theorem 18.41 The following proposition 
deals with the case of K'l -t- ptKt < for some t (cf. with (|46])). 

Proposition 9.4. (Wait if decrease of K outweighs resilience). 

Assume the dynamic spread model of Section\^ Let, for some t £ [0,r), K be continuously differentiable 
at t and p continuous at t with K[ + ptKt < 0. Then Brt — 0, i.e., c{t) ~ oo. 

Proof. Since K' + pK is continuous at i, we have K'^ + psKs < on an interval around t. Then there 
exists e > such that Kse~-I^=^ > Kt+e for all s e [t,t + e). By Proposition 15.81 it is not optimal to 
trade at t. □ 

Let us finally illustrate our results by discussing several examples. For simplicity, take constant re- 
silience p > 0. Then condition (j46|) takes the form 

Kt + pKt>0 on [0, T] and K^' + ipK[ + 2p'^Kt > on [0, T] . (47) 

A sufficient condition for (j47p . which is sometimes convenient (e.g. in Example 19.61 below) . is 

K't + pKt>0 on [0, T] and K't' + pK't > on [0, T] . 

In all examples below we consider 6 = and x G [0, oo). 
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Example 9.5. (Constant price impact Kt = k > 0) . 

Assume that the price impact Kt = k > is constant. Clearly, condition (|Tf|) is satisfied, so we can use 
formula ([55)1 to get the optimal strategy in both models. We have ft = ^ and 5^ = ■ '^^^ optimal 
strategy in both the dynamic and zero spread models is given by the formula 

X ,„ xp 



det 



■dt. 



+ pT + 2 

which recovers the results from Obizhaeva and Wang (2006). The large investor trades with constant 
speed on (0,T) and consumes all fresh limit sell orders entering the book due to resilience in such a way 
that the corresponding deviation process Dt is constant on (0,T] (see (|^^ and note that ft is constant). 
The barrier is linearly decreasing in time (see (j45p ): 

c(t) = ^^f^^—^, te[o,r), c(T) = o. 

K 

Let us finally note that the optimal strategy does not depend on k, while the barrier depends on k. See 
Figure [6] for an illustration. 




1 strategy 




Figure 6: Constant price impact {T = 1, p — 2, n = 1, x = 100, 5 — 0). 



Example 9.6. (Exponential price impact Kt = kc'^p* , k > 0, e R \ {0}). 

Assume that the price impact Kt = ke'^p* is growing or falling exponentially with 1/ G R \ {0} being 
the slope of the exponential price impact relative to the resilience. The case ^ = was studied in the 
previous example. We exclude this case here because some expressions below will take the form 0/0 when 
V — (however, the limits of these expressions as — >■ will recover the corresponding formulas from the 
previous example). Condition (|Tf)) is satisfied if and only if i/ > — 1. We first consider the case v > —1. 
We have 

V +1 , ft XKviv + 2) 

it = and O'^ = 



In particular, like in the previous example, the large investor trades in such a way that the deviation 
process Dt is constant on (0,r]. The optimal strategy in both the dynamic and zero spread models is 
given by the formula 

We see that, for = —1, it is optimal to buy the entire order at T. Vice versa, the initial trade AOq 
approaches a; as 00. The barrier is given by the formula 

Kv[v + 1) 
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(in particular, c{t) = oo for t ^ [0,T) ii ly — —1 and the barrier is finite everywhere if v > —1). For 
each V > —1, the barrier is decreasing in t, i.e. buying becomes more aggressive as the investor runs out 
of time. Furthermore, one can check that, for each t e [0,T), the barrier is decreasing in v. Tliat is, tlie 
greater is v, the larger is the buy region since it is less attractive to wait. Like in the previous example, 
the optimal strategy does not depend on k, while the barrier depends on k. 

Let us now consider the case ly < — 1 . In the zero spread model, transaction-triggered price manipulation 
occurs for v G (—2,-1) (one checks that the assumptions of Theorem l8.4l are satisfied) and classical price 
manipulation occurs for j/ < — 2 (see Proposition 18. 3p . In the dynamic spread model, for < — 1, it is 
optimal to trade the entire order at T because A'te^'''-^^*) > Kt for all t e [0,T) (see Proposition IS.Sp . 
Thus, in the case v < —1, we have c{t) — oo for t G [0,T). 

See Figure [7] for an illustration. 




Example 9.7. (Straight-line price impact Kt ~ k + mt, k > 0, m > — y). 
Assume that the price impact Kt = k + mt changes linearly over time. The condition m > 
that K is everywhere strictly positive. Condition ((47|) is satisfied if and only if m > — 3^2pT • ^^t^ that 

~3+^pT ~T' ^® ^^^^ assume that m > ^jT^fpT' ^^^^ case, the optimal strategy in both the 
dynamic and zero spread models is given by the formulas 

2m{m + Kp)x {2kp + m{3 + 2pt)) X 

(to + 2kp)to ' (m + 2np + 2mpt) in 

2mKpx ., _ - / m + 2kp + 2mpT\ 

ABt — 7 . , with to := 2to + nplog 



(to -I- 2kp + 2mpT)'m \ to + 2kp 

The barrier is given by the formula 

2to - (to + 2.p + 2mpt) log {j^^^ 



2m[m + up + mpt) 

In the zero spread model, transaction-triggered price manipulation occurs for to G (~ jTffpT ' ~ 3+2pT ) (^^^ 
Theorem l8.4p and classical price manipulation occurs for m G (— y, —YT^fpr) Proposition In the 
dynamic spread model, we can check by Proposition 15.81 that it is optimal to trade the entire order at T 

(see Lemma [B.ip . We observe that — ^ (l — e^P'^) < — 3^2pr (^^^ Lemma rB.2p . Let us finally note that 
the presented methods do not allow us to calculate the optimal strategy in closed form in the dynamic 
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spread model for m S — ^ (l — e p'^) , 



2pK 
' Z+2pT 



but we can approximate it numerically in discrete time 



(see e.g. the case with Kt = 1 — 0.6i, p = 2, T = 1 in Figure [4]). 
See Figure |S] for an illustration. 




Figure 8: Straight-line price impact (T = 1, p = 2, k = 1, a; = 100, 5 = Q,m = 0.5 and —0.7 (dashed)). 



10 Conclusion 

Time-varying liquidity is a fundamental property of financial markets. Its implications for optimal liq- 
uidation in limit order book markets is the focus of this paper. We find that a model with a dynamic, 
trading influenced spread is very robust and free of two types of price manipulation. We prove that value 
functions and optimal liquidation strategies in this model are of wait-region/buy-region type, which is 
often encountered in problems of singular control. In the literature on optimal trade execution in limit 
order books, the spread is often assumed to be zero. Under this assumption we show that time- varying liq- 
uidity can lead to classical as well as transaction-triggered price manipulation. For both dynamic and zero 
spread assumptions we derive closed form solutions for optimal strategies and provide several examples. 



A Integration by parts for caglad processes 

In various proofs in this paper we need to apply stochastic analysis (e.g. integration by parts or Ito's 
formula) to caglad processes of finite variation and/or standard semimartingales. As noted in Section [21 
this is always done as follows: \iU \& & caglad process of finite variation, we first consider the process C/+ 
defined by :— Ut+ and then apply standard formulas from stochastic analysis to it. As an example of 
such a procedure we provide the following lemma, which is often applied in the proofs in this paper. 

Lemma A.l. (Integration by parts). 

Let U = {Ut)t^[id,T+] o.'^d V = {Vt)t^[a.T+] be caglad processes of finite variation and Z a semimartingale 
(in particular cddlag), which may have a jump at 0. For t G [0, T], we have 

Ut+Zt = UoZo- + [ UsdZ, + [ ZsdUs, (48) 
J[o,t] J[o,t] 

Ut+Vt+ = UoVo + f UsdV, + f Vs+dUs. (49) 
J[o,t] J[o,t] 
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Proof. Let X and Y be cadlag processes (possibly having a jump at 0) with X being a semimartingale 
and Y a finite variation process. By Proposition 1.4.49 a) in Jacod and Shiryaev (2003), which is a variant 
of integration by parts for the case where one of the semimartingales is of finite variation, 

XtYt=Xo-Yo-+ [ Ys-dX,+ [ X.dYs, te[0,T]. (50) 

J[0,t] J[0,t] 

Equation is a particular case of ([50)1 applied to X := Z, Y := C/+ and equation ([^^ is a particular 
case of dSni) applied to X := V+ , Y := C/+, where C/+ := Ut+ and V^^ := Vt+. □ 



B Technical lemmas used in Example 19.7 



Below we use the notation of Example 19.71 

Lemma B.l. For m e (— ^, — f; (l — e"''"^)) we have 

(k + mt)e-P^^-*'^ > K + mT, t e [0, T), (51) 

i. e. Proposition \5.8\ applies. 



Proof. Inequality (j5ip is equivalent to 

K(l_e-KT-*)) 



TO < — - 



The assertion now follows from our assumption on to. To see this, we need to show that 



T ^ ^ - T_ te-PiT-t) ' 

which in turn is equivalent to 

1 _ e-p(7^-«) 1 _ e-P'^ 

9it) := ^ _ < = .9(0). 

This is a true statement since 1 ~ x < e^^ for all a; G R and therefore 

_ i-p(r-0-e-p(^-*) 

^ eP(T~*)(r-te-p(^-*))2 - 

□ 

Lemma B.2. We have -f (l - e"''^) < -3^^- 



Proof. The statement reduces to proving that 3^2pT < 1 ~ 6 '^'^ ■ Setting x := pT > we see that it 



IS 



enough to establish that e ^ < jqi^, which is true as, clearly, > 1 + ^x. □ 
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